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Field Of The Invention 

The present invention relates to methods and apparatus for transmitting 



multimedia in s communication network. More particularly, the present invention 
relates to methods and apparatus foi Iransmitling data packets containing audio 
and video, over a communication network, for example the Internet. 



commonly known, and perhaps the fastest growing of these is the internet. One 
Internet application, known as multimedia transceiver, enables users to transmit 
15 and receive audio, video and text over the Internet. An example of this 

application, known as Internet telephony client, allows for telephone call© over 
Ihe Internet 

In accordance with this Internet telephony client, a ueer dials the 
telephone number of a reclpienl user via a computer keyboard or the like. Wtien 

20 the call is established between the users, the Internet telephony client digitally 
samples the voice of one user, temporary stores thft samples in a buffer, and 
packages the samples into a data packet or packets. The data packet or packets 
is/are transmitted to a recipient user using an IP protocol. The recipient user 
receives the data packet or packets, strips them of the protocol headers and 

25 converts the samples Into voice. This method is also performed at the caller end 
of the internet connection pathway. 

This Intemet telephony client exhibits drawbacks In lhatthe voice quality 
on both ends of the communication pathway Is poor. Several methods have 
been attempted to improve this voice quality. 

30 At the sender end. these methods typically involve always transmitting 

packets that are built based on the parameters that are necessary for insuring the 
audio quality at the receiving side. These parameters can be redundancy, 
packaging schemes and/or patterns and compression type and/or rate. These 
methods exhibited drawbacks in that they did not adjust for changing network 
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conditions, whereby increases in the netvworit load continued to result in poor 
audio quality. 

Moreover, when video comrfiunications were added to these already poor 
quality audio communications, Ibe networl< load Increased. This increase 
5 resulted in further delay, noise and disturbance in audio, lowering its quality, and 
freezing of the video image. 

Summary Of The (nvention 

The present invention overcomes the disadvantages of the prior art by 

10 accounting for the networK conditions and transmitting audio, typically voice, in 
accordance with ttie sensed networl< condition. xSpecIflcally, the present 
invention allows for the detection of the network state and controlling of the bit 
rate transmission of a communication, in ordei lo improve the media quality of 
recipient, for example, a multimedia call, in accordance with the detected network 

15 state such that the audio quality of the communication is improved when 
compared to that of tf le prior art. 

in one aspect of the present invention, there is ptovided a method for 
transmitting packets over a packed switch network. The network includes a 
plurality of multimedia transceivers for sending and receiving multimedia 

20 communications such as audio and video, typically voice. 

The method Includes the steps of providing at least two predefined 
network states to be compared with a monitored network stale, monitoring the 
network slate, selecting one state of the at least two predefined network states 
in accordance with the monitored network state, sampling at least one type of 

25 media at a transmitter for providing at least one media sample, packaging 
network protocol parameters with the at least one media sample Into a packet, 
and transmitting the packet over the network, wherein the number of media 
samples in the packet is in accordance with the predefirred network state. 
Advantageously, a different type of packaging enables transmission of 

30 different lengths of packets with accordance to the network state. 1 his allows for 
a bit rate adjustment accordirig to the network available band width and state 
(condition), for improving received media quality at the receiver. 

In the preferred embodiment of the invention, llie steps of providing at 
least two predefined states further includes the steps of analyzing the network in 
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accordance with at leajsl one type of received media corrununication, categorizing 
the network into at least two networit states, tliese network states corresponding 
to tlie above described predefined network states, and for each networlt state, 
packaging at least one media frame with at least one parametftr. In this manner, 
5 the parameters are parameter;? for improving an audio quality of tf)e receiver. 

The invenrion also provides an apparatus tor transmitting packets over a 
packed switch network is provided. The apparatus Includes a means for 
providing at least two predefined network states and at least one predefined 
media constructing parameter such as a table in a memory. The apparatus 

10 further includes a monitor for monitoring a network state, a selector for selecting 
at least one state of the at least two predefined network states in accordance 
with the monitored network state, a sampling means for providing samples of at 
least one media type, a packaging means for packaging communication protocol 
parameters with media samples for providing a packet, and a transmitter for 

15 transmitting the packet, that has beer^ constructed in accordance with the 
detected network state. 

Brief Deecription Of The Drawin gs 

The present invention will be described with reference to the 
20 accompanying drawings, wherein like reference numerals and/or characters 
identify corresponding or like components. In the drawings: 

Fig. 1 is a block diagram of illustrating the present inventioti; 
Fig. 2 is a detailed block diagram ot a media transmitter in accordance 
with the present invention; 
25 Fig. 3a Is a diagram ot a packet for -a first protocol employed in the present 

invention; 

Fig. 3b is a diagram of a packet for a second protocol employed in the 
present invention; 

Fig, 4 is a table detailing audio packaging parameters in accordance with 
30 Ihe network state; 

Fig, 5 is a flow chart of ttie method of the preferred embodiment of the 
invention; 

Fig. 6 is a graph of bit rate versus frames per packet in accordance with 
the present invention; and 
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Fig. 7 is a chart of actual bit rates in accordance with the graph of Fig. 6. 

Detailed Deecription Of The Drawing^ 
Fig. 1 details the present invention In operation with a packet switch 
S network 1 for transmitting a data packet or packets. The packet switch network 
can be a wide area network and fur example, it couid be the internet. Multimedia 
transceivers 2-5, for sending and receiving multimedia communiuations over the 
networic l , are linked to the network 1 by conventional communication means. 
These communications typically involve multimedia calls, that include audio and 

3 n video, generated by a transceiver, such as transceiver 5 to another transceiver, 
such as ^anscaiver 4 over the network 1 . 

Transceiver 5, is exemplary of the other transceivers 2-4. All of these 
transceivers 2-5 typically include a transmitter 6 and a receiver 7. The 
transmitter 6 typically includes an audio transmitter 8 (in combination with an 

15 audio bit rate controller 19, as below, defines an audio channel), for transmitting 
audio packets over the networl< 1 and a video transmitter 9 (in comlsinaticn with a 
video bit rate controller 20, as below, defines a video channel), for trar»smitting 
video packets over the network 1 . The receiver 7 may include audio and video 
receivers (not shown) for receiving media transmissions that include audio and 

20 video. An example of such a transceiver is a computer program such as 

INTERNET PHONE® from Vocal Tec Communications, Ltd, Herzelia. Israel, that 
uses a PENTIUM® or PliNTIUM II® based personal computers (PCs), that 
includes audio and video cards and a network communication device or a 
modem to perform Ihe invention. 

25 Fig. 2 shows a block diagram of the transmitter Q, as in communication 

with tiie network 1 . The transmitter 5 Includes the audio transmitter 8, video 
transmitter 8 and a selecting means or selector 10, for controlling bit rate 
between the audio 8 and video 9 transmitters, for transmission of packets 
(detailed below) over the network 1 , 

30 The audio transmitter 8 includes an audio sampling device 1 1 , that 

samples the audio, such as voice from the user (U). This audio sampling device 
11 is opcrably coupled with a compiessing means 12, that communicates with a 
packaging means 13. 
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The compressing means 12 includes a voice activity detector (VAD) 14 
and an audio compressor 15. The voice activity detector 14 detects voice activity 
and transrers the voice samples to the audio compressor 15. The audio 
compressor 15 functions to compress voice samples and to provide at least one 
5 audio frame. 

The packaging means 13 includes audio packaging means 16, 
redundancy packaging means 17 and a Internet Protocol (IP) packaging means 
18. The audio packaging means 16 serves to package compressed audio 
frames Into a packet, while the redundancy packing means 17 is for packaging at 

10 least one redundant audio frame, corresponding to the packaged audio frame. 
The IP packaging msans 16 packages IP communication protocol parameters, 
for example, an IP protocol header, for providing a packet and transmitting this 
packet over the network 1 , typically the Internet, to the transceiver 4. This 
packaginfl is typically a packaging of audio frames in a single packet or multiple 

15 packets, as produced by the audio compi essor 1 5 (and ooffesponding video 
compressor 24, for video). Packaging into single or multiple packets typically 
involves using one or more (but at least one) communication protocol 
parameters, such as a number of frames per packer, redundancy or a 
redundancy scheme, for input to the IP packaging means 18. 

20 The video transmitter 9 includes a video sampling device 23, a video 

compressor 24 and packaging means 25. The video sampling device, 23 
samples the video signal and inputs the video samples to the video compressor 
24. The video compressor 24 compresses the video samples and provides at 
least one video frame. The packaging means 25 package the video frame with 

25 the communication protocol headers, for example, IP protocol headers, to 
provide a packet or packets, that will be transmitted over the network 1 . 

The selecting means or selector 10 includes media bit rate controllers, 
here, an audio bit rate control device 19 and a video bit rate control device 20 
and an allocalor 21 . These media bit rate controllers control transmission speed 

30 and tiie network load in accordance with the monitored network state. The 
allocator 21 is operably coupled to a network monitor 22, that monitors The 
network 1, for its condition, in real time, by receiving the network state, and at 
least one of the media bit rate controllers. The network monitor 22 provides the 
network state to the selecting means 10. Thi.<^ in turn allows the selecting means 
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10 to control Ihe video compressor 2A for packaging constructing parameters 
with video samples to provide best video quality at the transceiver 4. It also 
allows the allocator 21 in the selecting means 10 to select tho monitored network 
state that is most similar to one predefined network state, from a series of 
5 network states, stored ir i the allocator 2 1 . 

The allocator 21 may also include a data storage device (for storing 
databases, data, and the like), a data processor, such as a microprocessor or 
other computing or data pnDcessing means. Also the data storage device and 
data processor could be within the seleding means 10, external to the allocator 

10 2 1 , and could also be external to the transmitter 6. The audio bit rate control 
device 19 or video bit rate control device 20 receives ojmmands (in the form of 
data or signals) from the allocator 21 to raise or lower the respective bit rates 
(detailed below). Additionally, the audio bit rate control device 19 and video bit 
rate control device 20 include hardware and software for adjusting the bit rate 

15 transmieeion to the available bandwidth of network 1 . 

A signal from the allocator 21 inputs control data to the audio bit rate 
controller 19. This audio bit rate controller 19 controls the audio compressor 15, 
audio packaging means 16 and the redundancy packaginq means 17 of the 
audio transmitter 8. for packaging the parameters which result the best audio 

20 quality at the receiver 7 (Fig. 1 ). 

Fig. 3a is a description of a packet SO with accordance with a real time 
protocol (RTP), RFC 1889 as described in Schulzrinne. et al.; "RTP; A Transport 
Protocol for Real-Time Applications", Network Working Group. Standards Track 
RFC 1809, January 19S6 (hereinafter, "Standards Track-RFC 1889"), available 

25 at http://www.ietf.org/rfc/rfc1 889.txt. and incorporated by reference in its entirety 
herein. The packet 50 includes a plurality of fields of 32 bits. 

The first five fields. Version field (V), Padding field (P), extension field (X), 
CSRC count field (CC) and the marker field (M) are described in Standards 
Track-RFC 1869. 

SO A payload type (PT) field 52 Identifies the format of the RTP media data 

and determines its interpretation by an application. 

A sequence number field 54 increments by one for each RTP data packet 
sent, and may used by tho receiver to detect packet loss to restore packet 
sequence, the sequence number field 54 is 16 bits field. 

6 P-2ie3-US 
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A Timestamp field C7 includes 32 bits and reflects the time of the sampling 
instant of the firat byte of the present packet. The sampling instant must be 
driven from a clock that increments monotonlcally and linearly in time to allow 
synchronization and jitter calculation of media samples. 
5 A synchronization source identifier field 58 includes 32 bits and identifies 

the synchronization source. 

The last neld is a media field 59 which includes compressed media 
samples, TTie compressed media samples? may be audio or video samples. In a 
preferred embodiment, a G.723 codec Is used with a bit rate of 6400 bits per 
10 second. The audio samples are arranged in frames. Each frame includes 240 
audio samples which are compressed into 24 bytes wherein each byte Includes 8 
bits. The number of media frames may be varied in accordance with Ihe 
monitored network state. 

Fig. 3b is a deecrlption of a packet 70 with accordance to a real time 
15 protocol (RTP), RFC 2198, as described in Perkins et al.; "RTP Payload for 
Redundant Audio Data". Network Working Group Standards Trade RFC 2198. 
September 1997 (hereinafler, "Standards Track - RFC 2198"). available at 
http://www.letf.ofg/rfc/rfc2198.txt, and incorporated by reference in its entirety 
herein. The packet 70 includes a plurality of fields of 32 bits, and is detailed at 
20 page 8 of Standards Track-RFC 21 98. 

The first five fields. Version field (V « 2). Padding field (P), extension field 
(X). CSRC count field (CC = 0), sequence number field, timestamp field and 
SSRC field and the marker field (M) are similar to tiioss described for RFC 1889, 
in Fig. 3a above, and in Standards Track - RFC 1889. 
25 The packets 70 containing a primary data block 71 , and a single block of 

redundancy data 72 as defined In the Standards Track-RFC 2198 is illustrated. 
The description of the other fields is as follows: 

Tlie bits in the header 73 (outlined in solid lines in Fig, 3b) are specified as 
follows: 

30 The first bit in the header 73 indicates whether another header bock 

follows. If "1", further header blocks such as block PT=7 (block 74a) follow, if "0" 
this is the last header block, such as block PT=5 (block 74b). 

Block "PT=7" (block 74a) is the RTP payload type which may be audio or 
Video and which compressed in primary data block 71 . 
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The next block in the header 73 is the timestamp o^el block 75. this 
block relative to the timestamp given in RTP header, as described in Fig. 3a. 
The use of an unsigned offset implies that redundant data must be sent aftfir the 
primary data, and is henr.e a time to be subtracted from the current timestamp lo 
5 determine the timestamp of the data for which this block is the redundancy. 

1 he next block is block length 76, v/hich Indicates length in bytes of the 
corresponding data block excluding header. The header for the primary (final) 
block comprises only a zero F bit. and the block payload type information PT=5 
(block 74b). The final header is followed, immediately, by the data blocks, stored 

10 In the same order as the headers. 

The choice of encodings used should reflect the bandwidth requirements 
ot those encodings. It is expected that the redunriant encoding shall use 
slgnificarilly less bandwidth that the primary encoding; the exception being the 
case where the primary Is very low-bandwidth and has high processing 

15 requirement, in which case a copy of at least one audio or video frame, stored In 
the primary data block 71 may be used as the file redundant data 72. 

The use of multiple levels of redundancy Is rarely necessary, I lowevor, in 
those cases which require It, the bandwidth required by each level of redundancy 
is expected to be significantly less than that of the previous level. 

20 Network behavior is analyzed statistically and Is based on detected 

network behaviors. Networ1< states are defined, where in each state, a set of 
constructing parameters for constmoting the packet, needs to be determined. 

Bit rale control is in accordance with the Table of Fig. 4. In this table, 
there are four predefined network states: Regular, Loss, Delay, and Loss + D 

25 (Loss plus Delay), to which the actual detected network state is matched. Within 
each network state are bit rates for transmission, and corresponding quality 
states or quality degrees for the network state at the bit rate. These quality 
states (quality degrees) are defined as follows: H = high quality, the best quality 
state, transmitting one frame per packet and redundancy, wherein there is packet 

30 loss in the network; S = sutticient quality, the second best quality state (quality 
degree), transmitting more than one audio frame in a packet; and NS = 
non-sufTicient quality, the least quality of the three quality states, packet loss 
without redundancy. This Table (Fig. 4) was obtained by analyzing the network 
In accordance with a received audio communication, characterizing the network 
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into at least two states, and for each network state, packaging a number of media 
framfes in accordance with the network state. 

The apparatus and systems detailed above perform methods for 
transmitting packets in accordance with the present invention. These methods 
5 improve on the prior art transmitting methods, for they provide superior audio 
quality at the receiving side. An exemplary method, resulting in a transmission, 
such a mulUmedia call from transceiver 5 to transceiver 4 over the network 1 will 
be described now in accordance with Fig. 5. 

In Fig. 5, there is shown the method of the present invention. 1 his method 

10 may be performed for example, lo include stages of bit rate adji jstment In 

accordance with the network state. A first stage is a first or coarse adjustment of 
the bit rate, while the second stage is a second or fine adjustment of the bit rate. 
This two stage bit rate adjustment, for example, is performed by algorithms. 

A first algorithm is employed to detect the network state and pertorm a first 

15 or coarse adjustment ofthe bit rate in correspondence tiiereto, A second 
algorithm serves to cause a second or fine bit rate adjustment, to Increase or 
decrease bit rate upon detection of congestion in the network, 1 . The bit rate, 
having been subject to a first (coarse) adjustment, arid a second (fine) 
adjustment, if necessary, is then allocated among the audio and video channels 

20 by the allocator 2 1 , such that the audio transmission Is made with a proper bit 
rate allocated thereto In the preferred embodiment. It is preferred that this 
exemplary method be perfonned in intervale of 5 seconds. 

At step 202, the interval is at a time during the transmission of audio and 
video. The first algorithm monitors the state of the network 1, at step 204, via the 

25 network monitor 22. At this time, the bit rate is an initial bit rate transmission, that 
is either a predetermined default rate, typically one set for a regular network state 
with sufficient quality audio, as in Fig. 4 in the Table, a bit rate of 12533 bits per 
second, corresponding to a network state of "Regular", with a quality state 
(quality degree) of "S" denoting sufficient audio quality, or the bit rate of the 

30 previous transmission (the most recent intefval). 

This network state moniloring may be with an RTCP Protocol. In 
accordance with that detailed in Standards Track-RFC 1 889. that is part of an 
H.323 protocol. As part of the protocol, a test packet may be transmitted over 
the network 1. for example from transceiver 5 to transceiver 4, and back to the 
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transceiver 5. tg measure parameters, such as packel loss and round trip time 
(RTT) also known as round trip delay, the time it takes for a packet to travel from 
the sending transceiver through the network and back to the sending transceivei. 
Packet loss and RTT are detailed in Standards Track-RFC 1889. 
5 I he monitoring is such that the network monitor 22 Includes software and 

hardware for executing an algorithm able to detect at least two different network 
states- This monitoring is preferably continuous or at regular intervals, typically 
at time lengths of 5 seconds. 

Once the networic state is detected (upon monitoring), thfl network f nonitor 

10 22 sends data corresponding to the network state to the allocator 21 , that 

activates data processing means in the allocator 21 or the body of the selecting 
means 10 that executes an algorithm tor the audio, in accordance with the Table 
of Fig. 4, where a G.723 codec is used. T\m first algorithm is such that the 
network state, selected from four predetermined netwoiic states. Is closest to the 

15 detected network state. 

The network slate is checked to see if it has changed, by the first 
algorithm, at step 206. The decision of network state change is done by 
detecting conditions at step 206, are detailed as follows: 

1 . If the measured packet loss is less than 3% and the present network 
20 state is "Loss" or "Loss plus Delay", the network state should be changed to 

either "Regular" or "Delay", 

2. If the cun-ent network state is "Regular" or "Delay" and measured 
packel loss is greater then 5%, and network state should be changed to "Loss" or 
"Loss plus Delay", 

25 3. If the current network state is "Regular" or "Loss" and the measured 

round trip time (RTT) is greater then 1000ms, the network state should be 
changed to "Delay" or "Loss plus Delay". 

4. When the current network state is "Delay" or "Loss plus Delay" and the 
measured RTT is less then BOOma. the network state should be changed to 

SO "Regular" or "Loss". 

If any of the above conditions have been detected, the network state has 
changed. The changed network state is matched to one of the four 
predetermined network states, and hit rate adjustment is made in accordance 
with the Table of Fig. 4. at step 208. for the predetermined network state, to 
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which the detected nelwork state most closely corresponds. In making this first 
adjustment, the network monitor 22 signals the allocator 21 . in making this 
adjustment, the algorithm attempts to achieve a quality state (quality degree) of 
al least Sufficient Quality or "S". If the network state ha3 not changed, thijs first 
G bit rote adjustment is not made. This first algorithm is such that it attempts to 
achieve at te&si Sufficient Quality or "S" for the audio, so as to avoid changes of 
bit rate if possible. 

Turnins back to the table of Fig. 4, the quality states (quality degrees) are 
detailed. The "H" or High Quality state Is a monitored transmieejon of a packet, 

10 that includes a single audio frame for packets via the IP communication protocol, 
for example, RFC 2198, If the transmission is made with redundancy, this 
redundant transmission includes at least one redundant packet over the network 
with packet loss. Similarly, the "S" or Suffident Quality state is a monitored 
transmission of a packet, where 2-3 frames (audio) are packed into a packet via 

15 a protocol for redundancy (for ejiample, RFC 2 1 98), and redundancy used 
when the network has packet loss. Other protocols, that help to overcome 
packet loss, such as fonward error correction, are suitable for redundancy. 
Finally, the "NS" or Non-sufficiont Quality state is a monitored transmission of a 
packet via a protocol, for example, Rl-C 1889. that does not include the 

20 transmission of redundant packets, but results In packet loss In the transmission. 
Next, a second algorithm is employed to check (monitor) for network 
congestion level or delay. Congestion or delay is detected based on RTCP 
reports as sent from the network monitor 22 to the allocator 21 . In this 
Algorithm, conqestion is detected by analyzing three conditions, steps 220, 222 

25 and 224. If any of these conditions exist, the algorithm is such that bit rate is 
decreased in a second or fine adjustment at step 226, by a signal to the allocator 
21 from the network monitor 22. If a condition does not exist, this second 
algorithm moves to the next condition to see if it has been met. These conditions 
are as follows: 

30 1 . Is packet toes on RTF above 30% (step 220): if YES, the bit rate is 

decreased (step 226), it NO, the next yondition (step 222) is analyzed; 

2. Has packet loss increased, typically by a rise of at least 4%, less than 
20 seconds after the bit rate was raised (step 222); if YES, the bit rate is 
decreased (step 226), if NO, the next condition (step 224) is analyzed; or 
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3. Has the average RTT increased more then 70 msecs in a short time, 
approximalelY 20 seconds (step 22A): if YES, the bit rate is decreased (step 
226). if NO, the next condition all three conditions do not exist and the algorlthni 
continues. 

5 When congestion In the network not detected, network congestion over 

the last 20 seconds is diecked at step 230. if it has not been detected, bit rate is 
increased, by a second or fin© adjustment at step 232 in accordance with that 
detailed above. 

Congestion may also he caused by lack of available bandwidth on the 

10 network, that serves to limit the bit rate. In this case, bit rate will be adjusted in 
the manner of the second or fine adjustment, to select a network quality state "S" 
or "NS". from "H" or "S" respectively, in accordance with the available network 
bandwidtli. The networi< quality state is preferably adjusted to allow for 
tiansmission of at least two media streams, typically audio and video. By 

15 transmitting at these lower quality states, particularly "NS", transmission quality is 
being sacrificed in view of the available bandwidth. 

If bit rate has been increased at step 232 or if congestion existed in the 
netwQi1< over the last 20 seconds, the allocator 21. having been signaled to 
adjust bit rate, with both first (coarse) and/or second (fine) odjuetments. the 

20 second algorithm is now complete and the first algorithm Is resumed. 

The continuation of this first algorithm is such that the audio and video bit 
rate controls 19, 20 respectively, are queried for the total bit rate between the 
audio and video channels, at step 240, During this step 240, at least one. and 
preferably both the audio and video channels, are sampled by the audio 

25 sampling device 2 and video sampling device 23 respectively, in communication 
with their respective bit rate controllers 19, 20. The allocator 21 includes 
hardware and software that can detect the total bit rate by querying the bit rate in 
the audio and video bit rate controllers 1 9, 20 (a.<? per the audio and video 
channels respectively) and combining the bit rates to find the total bit rate at step 

30 240. Accordingly, the alocator 21 will know Ihe quality of the audio transmission 
in accordance with the Table of Fig. 4. Also, in accordance with the Table of Fig. 
4, the allocator 21 will know the total bit rate available, such that it can allocate bit 
rate between the audio and video bit rate controllers 19. 20, at step 242. In 
making the allocation, priority will always be given to the audio channel, such that 
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the minimum bit rate for the audio is in accordance with the bit rates of the table 
Fig. 4. 

With the bit rate now determined for tfie audio, and the video, It video Is 
being transmitted as part of the multimedia call, a package can now be 
C composed for transmission to transceiver 4. This package is constructed based 
on sending parameters, such as redundancy, of at least one fiame with each 
redundant pacltel. indicated in the Table ot Fig. 4 as "Redund" and the number ot 
audio frames per packet, indicated in the Table of Fig. 4 as "FRF. 

Fig. 6 shows a chart of hit rate versus frames (of audio) per packet for 

10 transmissions with a redundancy of 1 (line 260) and transmissions without 
redundancy (line 261). The cliart of Fig. 7 details the actual bit rales for the 
transmissions with redundancy in accordance with line 260 and without 
redundancy in accordance with line 261. When a redundant packet is 
transmitted, the redundant packet is preferably transmitted at a different protocol 

15 than the corresponding packet. For example, when the packet is transmitted in a 
first protocol, typically the RFC 1889. the redundant packet will be transmitted In 
a different protocol, typically RFC 2198. 

With the packets composed, the transmission is made. Monitoring 
continues for as long as desired, typically for the entire period of the 

20 transmission, with the above dfltailed method repeated (steps 204 to 242). over 
the course of the transmission. The repetition is typically in accordance wilh the 
monitoring periods for the network. 

The entire apparatus disclosed above may be implimented on a data 
processor, such as a microprocessor (linkfid to a storage device). For example. 

25 clietit applications using these techniques may be implimented under 

WINDOWS™ OS in Pentium based Personal Computers (PCs) with sound 
and/or video card.s for audio and video processing respectively. 

While preferred embodiments of the present invention have been 
described so as to enable one of skill in the art to practice the present invention, 

30 tile preceding description is exemplary only, and should not be used to limit the 
scope of the invention. The scope of Ihe invention should be determined by tfie 
following claims. 
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What is claimed is: 

1 . A methcxj for transmitting packets over a pacltet switch network wiiich 
includes a plurality of multimedia transceivers for sending and receiving 

5 multimedia communications, the method comprising the steps of: 

providing at least two predefined network states for comparing WAh a 
monitored network state; 

monitoring said network state; 

selecting one state of the at ieasl two predefined network states In 
10 accordance with said monitored network state; 

sampling at least one type of media at a transmitter for providing at least 
one media sample; 

pacl^aging said at least one media sample into a packet; and 
transmitting said packet over said network, wherein the number of media 
15 samples in a packet is in accordance with said selected predefined network 
stats. 

2. The rnetliod of claim 1 , wherein said at least one media sample includes a 
plurality of media samples, and said plurality of media samples are arranged in at 

20 least one frame within said packet, 

3. The method of claim 2, wherein said packaging step Includes packaging 
said at least one media sample in accordance with the media quality of the 
receiving transceiver. 

25 

4. The method of claim 3, wherein said packaging step includes packaging 
said at least one frame into said packet with a first network protocol parameter, 

5. The method of claim 4, wherein said first nelwork protocol parameter 
30 includes RFC 1889. 

6. The method of claim 3. wherein said at least one frame includes at least 
two frames, said at least two frames including at least one frame and at least one 
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redundant frame and said packaging step Includes packaging said at least two 
frames into said packet with a second network protocol parameter. 

7. The method of claim 6. wlierein said second network protocol parameter 
5 includes RFC 2198. 

8. The method of claim 1 , wherein said step of providing two predefined 
network states includes the steps of: 

analyzing said network in accordance with a received audio 
10 communication; 

categorizing said network into at least two states upon analyzing said 
network, said at least two states corresponding to said at least two predefined 
network states; and 

packaging at least one media fiame according to each of said at least two 
15 predefined network states, 

9. The metliod of claim 1 , wherein the step of monitoring comprises the 
steps of: 

transmitting a test packet between a first transceiver and a second 
20 transceiver; and 

measuring at least one network parameter for determining said network 
state at said first transceiver. 

1 0. The method of claim 9, wherein said a( least one network parameter Is a 
25 period of time for said test packet to travel from the first transceiver to said 

second transceiver and back to said first transceiver. 

1 1 . The method of claim 9, wherein said at least one network parameter is a 
count of packets lost in the transmission from first transceiver to the second 

30 transceiver and back to said first transceiver. 

12. An apparatus for transmitting packets over a packet switch network 
comprising. 
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Storage means foi storing data corresponding to at least two predefined 
network stfites for comparing with a detectfid network state; 

monitoring means for monitoring and detecting at least one network state; 

selecting means for selecting at least one state of the at least two 
5 predefined network state with accordance to said detected network state; 

sampling means for providing samples of at least one media type; 

pa<:kaglng means for packaging at least one protocol parameter with said 
media samples for providing a packet; and 

transmitting means for transmitting said packet in accordance with said 
10 detected network state. 

13. The apparatus of claim 12, wherein the sampling means comprises: 
an audio sampling device; and 

a video sampling device. 

15 

14. The apparatus of claim 12, further comprising; 

ar> allocator operably coupled to said monitoring means for receiving oaid 
network state; and 

at least one media bit rate controller for controlling transmission speed 
20 and said neiwori< load in accordance with said detected network state. 

1 5. The apparatus of claim 14, wherein said at least one media bit rate 
controller Is an audio bit rate controller. 

25 16. The apparatus of claim 15, wherein said at least one media bit rate 
controller is a video bit rate controller. 

1 7. An apparatus for controlling transmitting of media streams over a packet 
switch network comprising; 
yiJ a network monitor for monitoring a network state; 

a selector for selecting at least one state of the at least two predefined 
network states in accordance with said monitored network state; 

sampling means for providing at least one media sample of at least one 
media type; 
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compressing means for compressing said at least one media sample into 
at least one media frame; 

packaging means for packaging at least one communication protocol 
parameter with said at least one media fi-ame for providing a packet: and 
5 means for transmitting said packet which is constructed wilh accordance 

to said network state. 



18. The apparatus of claim 17. wherein said sampling means further 
comprise: 

10 an audio sampling device; and 

a video sampling device. 

19. The apparatus of claim 17, wherein said compressing moane comprise: 
an audio compression for providing audio frames; 

13 and a video for providing video frames. 



20. A method for transmitting packets over a packet switch network which 
includes a plurality of multimedia transceivers for sending and receiving 
multimedia communications, the method comprising the stops of: 

providing at least two predefined network quality states; 

monitoring said network to detect at least one network quality state: 

selecting one quality state from the at least two predefined networit quality 
states in accordance with said detected network quality state; 

creating at least one packet by placing at least one audio or video sample 
and at least one network protocol parameter into a package in accordance with 
said selected network quality state; and 

selecting a quality level in accordance with said .selected networi^ quality 
state tor packet transmission; and 

transmitting said packet over said network. 

21 . The method of claim 20, wiierein said network quality states are selected 
from the group consisting of; 

not sufficient quality; 
sufUcient quality; and 
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high quality. 

22. • A method of olaim 21 , wherfiin said not sufficient quality state is a 
monitored transmission of pacl<ets via a first protocol over said network which 

5 result a paoi<et loss 

23. The method of claim 22, wherein said sufficient quality state is a 
monitored transmission of packet which Includes at least two audio frames via a 
ssecond protocol which Includes at least one packet frame having at least one 

10 redundant frame over said netwot k. 

24. The method of claim 23, wherein said sufficient quality state is a 
monitored transmission of a packet which includes at least two audio fi-ames via 
the first protocol over said network, which transmission result a packet los.<!. 

15 

26. The method of claim 21 , wherein said high quality state Is a monitored 
transmission of a packet which includes a single audio frame via tlie second 
protocol over said network, which transmission result a packet loss, 

20 28. The method of claim 2b, wherein said high quality state is a monitored 
transmission of a packet which includes a single audio frame, via said first 
protocol over said network. 

27. The method of claim 21 , wherein the step of selecting said quality state 
25 fui Iher includes the step of: 

selecting a network quality state in accordance with an available network 
bandwidth. 

28. The method of claim 27, wherein the step of selecting compriees; 

30 selecting a lower quality state from said presently selected quality state if 

available network bandwidth Is decieased. 

29. A method for transmitting at least one par.l<et over a packet switch network 
comprising the steps of: 

18 P-2163-US 
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monitoring said nelwork for determining tiie available bandwidth for 
transmission over said network; and 

determining a quality state for transmission, said quality state 
corresponding to said detected avallatjie bandvyfldth; 
5 adjusting bit rate for transmission in accordance with said determined 

quality etate; and 

transmitting said at least one packet over said nelwork in accordance with 
the adjusted bit rate. 

10 30. The method of claim 29, wherein said step of adjusting bit rate includes 
the step of: 

increasing bit rate for transmission with increased quality upon detection 
of increased available bandwidth. 

15 31 . An apparatus for transmitting packets over a packet switch network 
comprising: 

a storage device having means for providing at least two predefined 
network states for comparing with a detected network state; 

a moiiitor for operativsly connecting to said network for monitoring said 
'^0 network and detecting at least one network state; 

a selector for selecting at least one state of the at least two predefined 
network states with accordance said detected network state; 
a sampler 

a packager, said packager for creating packets including camples of 
25 media from said sampler; and 

a transmitter for transmitting said packets in accordance with the detected 
network state. 

32. The apparatus of claim 31 , wherein the sampler includes: 
30 an audio sampling device; and 

a video sampling device. 

33. The apparatus of claim 31 , further comprising: 
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an allocator operably coupled to said monitor for receiving signals 
corresponding to said delected network state; and 

at least one media bit rate controller for controlling transmission speed 
and said network load with accordance with said detected network state. 

34. The apparatus of claim 33, wherein said at least one media bit rate 
controller Is an audio bit rate controller. 



35. The apparatus of claim 33, wherein said at least one media bit rate 
10 controller is a video bit rate controller. 



36. A method for packaging a packet for transmis.«*ion over a packet switch 
network, comprising the steps of: 

monitoring said network for available bandwidth; 
15 detecting said available bandwidtli; 

establishing a bit rate for transmission in accordance with said delected 
available bandwidth; and 

packaging media frames and protocol parameters in accordance with 
established bit rate, 

20 

37. The method of claim 36, wherein said packaging step includes providing 
at least one redundant fl-arne with a second protocol packet when said bit rate is 
above a predetermined value. 

26 38. The method of claim 36, winerein said packaging step includes packaging 
with a first protocol packet when said bit rate is below a predetermined value. 
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ABSTRACT 

There is disclosed an apparatus and methods for adjusting of bit rate 
transmission in a communication network by fnonitoring the state of the nelwork, 
detecting the state of the network and transmitting a multimedia call over the 
network in accordance with the network state detected. In accordance with the 
invention the network state is monitored with the bit rate adjusted in accordance 
with the network state detected. This results in a multimedia call with greatly 
improved audio quality. 
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FIG. 2 
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